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Machine Learning 

- Grew out of work in AI 

- New capability for computers 
Examples: 

- Database mining 

Large datasets from growth of automation/web. 

E.g., Web click data, medical records, biology, engineering 

- Applications cant program by hand. 

E.g., Autonomous helicopter, handwriting recognition, most of Natural 
Language Processing (NLP), Computer Vision. 

- Self-customizing programs 

E.g., Amazon, Netflix product recommendations 

- Understanding human learning (brain, real AI). 
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Machine Learning definition 



Arthur Samuel (1959). Machine Learning: Field of study that gives 
computers the ability to learn without being explicitly 
programmed. 

Tom Mitchell (1998) Well-posed Learning Problem: A computer 
program is said to learn from experience E with respect to some 
task T and some performance measure P, if its performance on T, 
as measured by P, improves with experience E. 
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achine learning algorithms: 

Supervised learning 
Unsupervised learning 

Others: Reinforcement learning, recommender systems. 
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_ Housing price prediction. 




Supervised Learning 
“right answers” given 
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Regression: Predict 
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Classification 

Discrete 
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Tumor Size 

only one feature or one attribute, mainly, the tumor size is used in order to predict 

whether the tumor is malignant or benign 
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You re running a company, and you want to develop learning algorithms to address 
each of two problems. 

Problem 1: You have a large inventory of identical items. You want to predict how 
many of these items will sell over the next 3 months. 

Problem 2: Youd like software to examine individual customer accounts, and for 
each account decide if it has been hacked/compromised. 

Should you treat these as classification or as regression problems? 

Treat both as classifïcation problems. 

Treat problem 1 as a classification problem, problem 2 as a regression 
problem. 

Treat problem 1 as a regression problem, problem 2 as a classification 
problem. 

Treat both as regression problems. 
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Supervised Learning 
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So what Google News has done is look for tens of thousands of news 
stories and automatically cluster them together. 

So, the news stories that are all about the same topic get displayed 

together. 
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Individuals 

Heres an example of DNA microarray data. 

The idea is put a group of different individuals and for each of them, you measure how 

much they do or do not have a certain gene. 

Technically you measure how much certain genes are expressed 

[Source: Daphne Koller] Dr Sherin E1Gol<h y 
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Individuals 

Run a clustering algorithm to group individuals into different categories. 

So this is Unsupervised Learning because we're not telling the algorithm in advance 
that these are type 1 people, those are type 2 persons, those are type 3 persons and so. 



[Source: Daphne Koller] 
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Organize computing clusters 



Market segmeiflagon 
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Social network analysis 




Astronomical data analysis 
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Of the following examples, which would you address using an 
unsupervised learning algorithm? (Check all that apply.) 



Given email labeled as spam/not spam, learn a spam filter. 

Given a set of news articles found on the web, group them 
into set of articles about the same story. 

Given a database of customer data, automatically discover market 
segments and group customers into different market segments. 

Given a dataset of patients diagnosed as either having diabetes 
or not, learn to classify new patients as having diabetes or not. 
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